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Abstract. - The order parameter P(q) for disordered systems with degenerate ground-states is 
reconsidered. We propose that entropy fluctuations lead to a trivial P(q) at zero temperature 
as in the non-degenerate case, even if there are zero-energy large-scale excitations (complex 
energy landscape). Such a situation should arise in the 3-dimensional ±J Ising spin glass and 
in MAX-SAT. Also, we argue that if the energy landscape is complex with a finite number of 
ground-state families, then replica symmetry breaking reappears at positive temperature. 



Introduction. - A number of disordered and frustrated systems [Jlj] exhibit replica sym- 
metry breaking (RSB) physically, this means that several macroscopically different valleys 
contribute to the partition function in the thermodynamic limit. Perhaps the most famous 
case is the Sherington-Kirkpatrick (SK) model of spin glasses, but RSB is believed to arise 
in diluted mean field models j3[j^] too. Furthermore, there is an ongoing debate over the 
presence of RSB in the Edwards- Anderson (EA) spin glass model in d > 3. Most Monte Carlo 
simulations || give evidence in favor of RSB there, but it has been objected that the temper- 
atures used (T ss 0.7 T c ) were too close to T c . Also, recent work going to zero temperature j?J 
suggests that there is no RSB in the d = 3 case, so this issue remains open. 

The order parameter for RSB is the presence of a non-trivial probability distribution for the 
overlap q between two configurations taken at random according to their Boltzmann weight. 
In the mean field picture of generic random systems, there are macroscopically different valleys 
whose free-energies differ by O(l), and thus P(q) is non-trivial. However, since the inter-valley 
part of P(q) decreases linearly with the temperature T as T — > 0, the zero temperature limit 
of P(q) is trivial: only intra-valley overlaps survive. It is often believed that this pattern is 
modified when the energy is a discrete variable and the ground-states are highly degenerate. 
Indeed, it is common lore that models with discrete energies such as the ± J EA spin glass 
or MAX-SAT near but below the transition point ^ should have a non-trivial P{q) if the 
mean field picture is correct, whereas the presence of a trivial P{q) is considered to validate 
the droplet model Here we go against this standard lore, and we will try to convince the 
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reader that instead of examining P(q) among ground-states it is more appropriate to consider 
the energy landscape and determine whether there exist macroscopically different valleys. We 
believe our conclusions apply not only to the 3-dimensional ± J EA model, but also to other 
discrete energy models such as diluted fully-frustrated magnets, MAX-SAT, and diluted mean 
field ± J Ising spin glasses to name just a few. 

Our first claim is that P(q) in these models is trivial when considering ground-states or 
even finite energy excited states. Our second claim is that replica symmetry is broken (P(q) 
is non-trivial) at arbitrarily low temperatures in the thermodynamic limit. In effect, discrete 
and continuous energy models behave similarly with respect to RSB. At the heart of our 
arguments is the hypothesis that the effective number of ground-state families does not grow 
with the system size. (Thus our claims do not apply the 2-dimensional spin glasses.) The 
presentation that follows is given using the 3-dimensional EA model for definiteness, but the 
reader can easily see how to rephrase the discussion for any model with a complex energy 
landscape. 

P{q) for ground- states. - In the 3-dimensional ± J EA Ising spin glass Hamiltonian, 



the Jij are quenched random variables, Jjj — ±1, that couple nearest neighbor spins on a 
lattice of size L x L x L. The Jy are discrete so the energy is also discrete. Furthermore, the 
local field felt by any spin can have the values ±6, ±4, ±2, only. A field value of leads to 
a spin that can flip without changing the energy. Since a finite fraction of the spins on the 
lattice have this property, there is a finite entropy per spin at the ground-state energy level: 
the number of different ground-states grows at least exponentially with the lattice volume. 

A question of central importance is whether these ground-states differ macroscopically. 
Unfortunately, this question is ambiguous because of the finite density of zero-energy droplets: 
if we flip all the spins in zero field, do we reach a macroscopically different ground-state? We 
would like the answer to be no . To make things simple, suppose for this discussion that 
L = oo; if all the ground-states differ only by zero-energy droplets containing say 1, 2, 
k spins, then we can say that they form a single family of ground-states. In that case, one 
expects P(q) to be a delta function at qEA < 1- (Here and in all that follows, our statements 
are made modulo the up-down symmetry which flips all the spins.) If we let k — > oo, we still 
have a single family of ground-states provided the frequency of zero-energy droplets decreases 
sufficiently rapidly as their size k grows. This is what happens in the "hidden ferromagnet" 
picture of spin glasses due to Fisher and Huse |J . In the same vein, when the ground-states 
form multiple families, one can hope that the ground-states belonging to the same family will 
differ by finite size droplets only whereas ground-states from different families should differ by 
at least one infinite zero-energy droplet, plus any number of finite size zero-energy droplets. 

When L is finite, it is even more difficult to define ground-state families satisfactorily 
because zero-energy droplets can arise with as large a k as one wants; there is thus inevitably 
some additional arbitrariness in one's definition of these families. One rather simple definition 
was proposed and used by Hartmann 0: two ground-states are in the same family if it is 
possible to go from one to the other by a sequence of zero-energy droplets of size k = 1. But this 
also means that two ground-states differing by a zero-energy droplet of size 2 may be put into 
two different families. Thus it seems more appropriate to define families by clustering together 
ground-states when their overlap is "sufficiently large". In the case of one-step RSB, this is 
quite clean, the overlaps being either small or large. When confronted with continuous RSB 
though, the overlaps cannot naturally be split into small and large values: there are families 




(1) 



<ij> 



F. Krzakala and O.C. Martin : DISCRETE ENERGY LANDSCAPES AND RSB AT T=0 3 




Fig. 1 - a: All spins of ground-state 1 having zero local field (crosses), b: We flip a system-size 
connected cluster and reach ground-state 2; the solid line is the boundary of that cluster. Only those 
zero local field spins that touch the boundary are relevant for the difference in entropies of the two 
families of ground-states. 



within families ad infinitum, and a cut-off on the overlap has to be introduced, otherwise the 
number of families will necessarily be infinite. Because of this arbitrariness, the clustering 
is less elegant than for one-step RSB; nevertheless, this clustering-based procedure can and 
has been implemented by Hed et al. ]l0| . Their conclusion, as well as Hartmann's jy], who 
sampled P(q) amongst ground-states, is that there exists multiple macroscopically distinct 
families with a finite (non-zero) probability as L — > oo. 

Given such a clustering-based definition of ground-state families, we shall assume hereafter 
that the model under consideration can have multiple families and thus there is a finite 
probability of having macroscopically different ground-states. If, when taking the large L 
limit, this definition of families is good, one may for convenience qualitatively think of a 
family as all those ground-states obtained from a given one by flipping zero-energy droplets 
of finite size. On the contrary, when going from one ground-state family to another, it is 
necessary to flip a "system-size" connected cluster of spins that contains a finite fraction 
of the whole system. This is illustrated schematically in Figure |].b where the solid lines 
represent the boundary B of such a system-size cluster. (The picture is for a cross-section of 
the 3-dimensional lattice.) 

In this kind of system, what does the distribution P(q) of ground-state overlaps look like? 
For simplicity, suppose that there are just two families, containing Vi and V2 ground-states. 
For the purpose of comparing the Vi, we consider that each family is obtained from one 
reference ground-state Ci by flipping any number of its zero-energy droplets, taken to be non- 
adjacent (and thus non- interacting) . Let Af[ be the number of zero-energy droplets of size k 
of Ci. Then we have Log^i = +A^ 2 ' + • • ■; clearly Vi, which is crucial for the structure 
of P(q), is very sensitive to the exact number of zero energy droplets in the family. We expect 
N"i to be self-averaging, growing linearly with L 3 '. But there are also fluctuations in this 
number; if the central limit theorem holds, they will scale as L 3 / 2 , so that the total number 
of zero-energy droplets jVj of Ci has the form 

k 

where Xi is a (Gaussian) random variable. P(q) has both inter and intra-family contributions. 
There are Vf + Vf ground-state pairs giving the intra-family part, and 2Vi V2 pairs giving the 
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inter- family part. We then see that the intra- family part dominates the inter-family part by a 
factor 2 ( - xl - x ^Vf^ (we took x x > x 2 ). Since this factor diverges as L — > oo, we find no RSB. 

Upon closer examination, we see that it is necessary to be more careful because maybe 
x\ ~ x 2 - In Figure [|.a we show by crosses the spins of ground-state 1 (Ci) having zero local 
field whose number is M^ . Figure ||.b shows the boundary B of the system-size cluster that 
takes one from family 1 to family 2. It is evident that except for the sites touching B, the 
spins having zero local field are the same in family 1 and in family 2. These spins then do 
not contribute to the difference 

M 1} However, for the spins that do touch B, their 

local field can and usually will be different in the two families. Denoting by A the area of B 
(in fact the number of spins touched by B), the argument that lead to Eq. || suggests that 
Afl — N2 scales instead as VA. Extending this to all droplet sizes, we obtain 

M - M 2 w yi 2 VJ (3) 

where y\ 2 is another (Gaussian) random variable with finite variance. We then see that the 
previous claim still holds, namely that intra-family contributions dominate the inter-family 
ones because A diverges when L — ► 00. (By hypothesis, the number of spins that are flipped 
when going from one family to another scales as L 3 , so A grows at least as L 2 .) 

This presentation was given for two ground-state families. Extending it to any finite 
number of families is straight-forward; what really matters for the argument to go through is 
for Mi — Mj to diverge for any pair of families. This will happen as long as the number of 
families does not grow too quickly with L. To stay as simple as possible, we will continue to 
assume that the model has a finite number of ground-state families. Then the infinite volume 
limit of P{q) is trivial (delta functions at ±qEA) because of entropy fluctuations amongst the 
different families. But the trivial nature of P(q) should not be considered as evidence against 
having finite-energy large-scale excitations (0 = in the language of the droplet model), nor 
against the mean field picture for that matter, as we shall soon see. Finally, there is every 
reason to expect the reasoning to apply to all discrete models, on lattices or not. For instance 
in the ± J Viana-Bray model, A scales as the total number of spins, so the triviality of P(q) 
for ground-states should be easier to see than in the EA case. 

In a numerical study, the factor 2 V12 ^ should be large. Then for most settings of the 
disorder variables Jy, the inter- family peak in the distribution Pj{q) of ground-state over- 
laps will be small compared to the intra-family term. However, y\ 2 has a finite probability 
density at 0, so with probability \j\fA the two peaks will be of comparable size. Thus the L 
dependence of P(0) (Pj(0) averaged over disorder) should go as \j\fA which is faster than 
1/L. Hartmann [Q indeed finds that P(0) decays, and his fits indicate a 1/L 125 dependence. 
Taken at face value within our framework, this means that A(L) « L 25 . 

In the picture we have reached, P(q) is trivial but the energy landscape is "complex" ; 
by that we mean that macroscopically different ground-states appear (taking into account 
of course the global up-down symmetry). The numerical results in support of this 

picture no longer seem mysterious from a mean field perspective, and lead us to conclude that 
models with discrete and continuous energies behave similarly: neither have RSB at T = 0. 
Note that RSB at T = implies a complex energy landscape, but the reverse is not true. 

P(q) for excited states. - The arguments we gave go beyond just ground-states. Consider 
the energy landscape of the system, and think of it as composed of different valleys. In this 
section, we focus on those valleys whose bottom energies are less or equal to some arbitrary 
fixed cut-off E max . We can consider P(q) for overlaps either among the bottoms of these 
valleys, or among all spin configurations of energy E < E max . (Note that the configurations 
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are not weighted by a Boltzmann factor.) Interestingly, the result is the same in both cases, 
so let us begin with the first one which is simpler. 

When E max is equal to the ground-state energy, the valley bottoms considered are precisely 
the set of ground-states, and we have clustered these into families. Since defining these families 
required some arbitrary choices, we see that the same must be true for defining valleys. Thus 
let valleys be also defined by clustering according to overlaps. The we generalize to valleys a 
property we used before for ground-state families: for each discrete energy level Ei < E maxi 
we assume that there is a finite probability of having multiple valleys whose bottom energy 
is Ei. Furthermore, as before, we suppose that the number of such valleys remains finite 
as L — > co. Then, regardless of their energy, the valley bottoms play the same role as the 
ground-state families of the previous section. In consequence, when comparing any two valley 
bottoms, one will dominate the other. The situation is thus identical to the one we had when 
looking only at ground-states, and we conclude that P(q) for overlaps between the valley 
bottoms is trivial as L — > oo. 

Two comments arc in order. First, which valley dominates is a random process. As these 
valleys have energies differing only by O(l), they should have the same statistical properties, 
so the probability of dominating should be uniform among the different valleys. But since we 
also expect the typical number of valleys to increase with energy, the winning valley will most 
likely be near the cut-off E max . The second comment is that since entropy fluctuations lead 
to single valley dominance, the reasoning suggests that P{q) is trivial at positive temperatures 
also. This extrapolation will turn out to be too naive: having a positive temperature requires 
taking E max to oo, and then we have to deal with an infinite number of valleys. Before looking 
into that case, let us go on and investigate as promised the effet of positive energy excitations 
within the valleys. 

Thus, we now consider all the configurations satisfying E < E max . We can estimate the 
size of the valleys (bottoms and higher energy configurations) by including the possibility of 
flipping positive energy droplets. Because the energy is discrete and bounded by E max , for each 
valley we can only flip a finite number of such droplets. If we consider all the configurations 
obtained from a valley bottom by flipping k such droplets, we find that their number is 0(L 3k ) 
times larger than the number at the bottom of the valley. Obviously this power-law factor 
cannot beat the 2 Vij ^- factor, and positive energy droplets lead to "negligible" corrections to 
the valley entropies. The fundamental reason is that the cut-off E max puts a bound on the 
number k of positive energy droplets that can be flipped. 

P(q) at a positive temperature. - When T > 0, the number of positive energy droplets 
that can be simultaneously excited grows linearly with the volume of the lattice. Since we 
have no reason to excite a finite size droplet of energy E rather than a system-size cluster of 
the same energy, we see that we have to let E max go to oo. Then we have a infinite number 
of valleys to consider! To make progress, we must describe how these valleys are distributed 
and then estimate their contributions to the partition function. 

As was done implicitly when discussing the excited states in valleys, we heuristically view 
a valley as a ground-state plus all of its possible (finite size) droplet excitations. This is 
certainly only part of the picture even when just considering the ground-state energy level, 
but it will do for our presentation. We begin with a statistical description of the number of 
valleys whose bottoms are at the energy level E. In our complex energy landscape, there are 
more and more such valley bottoms as E grows; we denote by Pe(E) their density. In the 
"random energy model" fL2| and in the SK model, this density grows exponentially with E; 
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here we need not be so explicit, we just take 

p E (E) = e s ^ = e S(E')+{E-E-)S'(E*)+- (4) 

where S(E) is a smoothly growing function and E* is any large argument. The important 
hypothesis we make is that S(E) does not grow with L; this must be the case if there is to be 
a finite number of valleys whose bottoms are at the different (discrete) values of E. 

Now we want to determine the density pp of free-energies of these valleys when the tem- 
perature is T. First, the free-energy Fi(T) of valley i is defined via: 

e t — e t 2^ e T (5) 
c 

where ^ c denotes the sum over all configurations C belonging to valley i, and Ei is the energy 
of the valley's bottom. Second, we make the hypothesis that the free-energy Fi(T) of valley 
i, when measured with respect to the energy Ei at its bottom, is a random variable behaving 
for instance according to what the central limit theorem would predict were it applicable: 

Fi(T) =Ei+L 3 f(T) + Xi^ (6) 

Here f(T) is the (self-averaging) free-energy density, and Xi is a (Gaussian) random variable 
whose variance depends on T . This ansatz is based on the idea that the valleys are statistically 
similar, and so the second factor on the right-hand-side of Eq. ghas no statistical dependence 
on the value of Ei. Put simplistically, there is no way to know within one of these valleys 
whether or not it contains the ground-state. 

Given our ansatz, the density pf(F) of the valley free-energies can now be computed. 
From Eq. ^, pp(F) is obtained by a convolution of pe(E) with a Gaussian distribution G(x): 

/OO POO 
PE {E)dE I G(x) S(F~E~ L 3 f(T) - xVU)dx (7) 
-oo J — OO 

First, use the S function to perform the integral over x. Then, because Pe(E) grows steeply, the 
integral's main contribution comes from the neighborhood of E*, a large value of E. Finally, 
we use Eq. |4|; defining l/T* = S'(E*), the integrand becomes a Gaussian in E. Performing 
the integral then leads to 

F-F* IT) 

p(F) = (8) 

where F*(T) L 3 f(T) is a reference free-energy. The important point is that pf(F) grows 
exponentially with F: we obtain exactly the form given by the random energy model and 
by mean field theory. For such a pp, the lowest (valley) free-energies differ by O(l), and so 
multiple valleys contribute to the partition function even as L — > oo. The conclusion is that 
for positive temperatures below T* , there is RSB, and P(q) is non-trivial. 

After all this is said and done, we realize that we have made the same mistake here as 
when we estimated P(q) for ground-states. Indeed, in Eq. |], the Xi of the different valleys 
are correlated. What is relevant is the scaling of the differences in the valley free-energies. 
Generalizing the argument used for ground-states, we replace Eq. || by 

Fi (T) - Fj (T) =Ei- E,j + Vij y/A~ (9) 

Taking any scaling form for Aij, we substitute in Eq. [7] the term x^fU by a term y^j 1 A(V)\ 
up to unimportant prefactors, this leads to the same exponential law for pp as before, and 
thus to RSB. 
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It is also possible to extend the calculation using a very different ansatz. Assume that 
energy differences between valley bottoms are not O(l) but instead scale as L e . Then one 
finds that the free-energy differences also scale as L e . 

Summary and conclusions. - In a general system with quenched disorder, we say that its 
energy landscape is "complex" if there are macroscopically different valleys with O(l) energy 
differences. When the energy is discrete, (as in the ±J Ising spin glasses), the ground-states 
can be highly degenerate, but we expect to be able to clusterize them into families. If the 
number of such familiess remains finite in the infinite volume limit, then we expect just one 
family to dominate all the others by its size. This effect is simply due to entropy fluctuations 
among the different families, and leads to the absence of replica symmetry breaking at zero 
temperature. The absence of RSB (that is a trivial overlap distribution P(q)) at zero tem- 
perature does not necessarily validate the droplet model. Instead, our over-all message can 
be summarized as follows: "A system having valleys with 0(1) energy differences (a complex 
energy landscape) should lead to a free-energy landscape with 0(1) free-energy differences, 
and thus to RSB" . It is thus not relevant to look at P(q) at zero temperature, nor even P(q) 
among finite energy excited states; the energy landscape seems to be a better object to con- 
sider when trying to distinguish the droplet and mean-field pictures. Amuzingly, we see that 
the discrete nature of the energies plays no role in determining whether there is RSB or not, 
be-it at zero or at finite temperature. 

Our point of view allows one to understand a number of numerical results on the ±J EA 
model Furthermore, it suggests that when going to very low temperatures |u|, it 

is important to control the limit L — > oo before taking T — > 0. Finally, we predict that a 
careful study of ground-states in MAX-SAT will give a trivial P(q) rather than a one-step 
RSB pattern. 

* * * 
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